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ABSTRACT 

RESPONSIVE EfJviRONMENl EARLY EDUCATION PROGRAM (REEEP): 
FIRST YEAR EVALUATION STUDY, END OF YEAR .EVALUATION REPORT, 1975-75 

Askins, Billy E. et al 

\. ■ . * . ■ • 

Related 'Documents: See ED 085 122, ED 096 086, and ED 111 562. 

Suggected Descriptors: PKeschool EducatWr AcadertiicalTy Handicapped; • 
Demonstration Program; Intervention; Bilingual Education; Handicapped 
Students; Low Birth Weight Children; Language Development; School Readi- 
ness Tests; Self Concept and Personality Development; Teacher Training; 
Program Evaluation. 

This report describes an external evaluation study of the Responsive 
Environment Early Education Program (formerly the Responsive Environment 
Program for Spanish American Children). This program serves as an educa- 
tional intervention providing direct services^ to "high risk" (low birth , 
weight-less than 5% pounds) 3-, 4-, and 5-year-old children, including the 
integration of handicapped children, living in the area served Dy the 
Clovis Municipal Schools, Clovis, NeV Mexico. In idditiqn, the program- 
serves as a base for training selected early childhood and kindergarten 
teachers and aides. 

The major goals fo '£he program are: (1) To prevent- school failure 
with an intervention progv-am which includes early identification and 
remediation of developmental learning deficiencies and to intergrade handi- 
capped childrer) into the regualr school program; (2) To provide in-service 
training to selected early childhood and kindergarten teadhers and aides 
employed by various school districts of New Mexico; andj3) To disseminate 
information concerning the program. 



Evaluaeion D' the instructional • activities was based on a pre- 
posttest design (without a control group") using standardized test which 
measured language development in Spanish and English, school readiness,' 
and self concept and personality development. In-service training and 
dissemination activities were subjectively evaluated using site-visits, 
observations, records, and self-reports by the staff. Findings *«of the 
follow-up study of former REPSAC students are reported in a separate study. 

Major findings included: (1) Students made significant gains in 
language development in Spanish and English and in general school readiness 
(2) Students developed and/or maintained a positive self concept and sub- 
stantially developed in various dimensions of personality growth; and (3) 
An outstanding in-service training program was provided. 
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FOREIJORD 



This evaluation report describes the effect of the Responsive Enviro,n- 
rent Early Education Proaram (REEEP) durinq the school year 1975-76. This 
renort is the result of a continuing external evaluation study being con-' 
ducted by B. £. Askins and Associates which" is an Independent consultant and 
service oroanization with its direction primarily through various faculty 
merbers of the College of Education, Texas Tech. University. 

The evaluation team recognizes and hereby expresses appreciation to 
the director, faculty, and staff of REEEP for their excellent cooperation 
during the evaluation process, especially during the periods of testing the v' 
young children. ^ 

The invaluable assistance of the various professional and paraprofes- 
sional personnel on the evaluation team is also acknowledged and appreciated. 

This report v/as prepared and submitted in accordance with the approved 
Continjation Evaluation Proposal for 1975-76 dated May 22, 1975 and the 
Educational Evaluation Agreement dated August 20, 1975. 



Billy (. Askins, Ed.D. 

Coordinator of Evaluation and Research 

June, 1976 
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YEAR-END EVALUATION REPORT 

SECTION r- 
' ■ INTRODUCTION 



This end-of-year evaluation report describes an external evaluation 
study of the Responsive Environment Early Education Program (REEEP) during 
the' school year 19'75-7f. This report is part of a continuation evaluation 
study beiag conducted by B. E. Askins and Associates which is ^n independent 
consul rant-' and service proanization v/ith its direction primarily through 
various faculty 'nie.'iibers of the College of Education, Texas Tech University. 



Purpose of the Program 

the rajor purpose of REEEP is to serve as an effective earl^ educational 
intervention for 3-, 4-,. and 5-year-oia "high risk" children li>5^ing'in the 
area served bv Clovis Municipal Schools, Clovis, New Me;<ico. Children are 
considered "hiqh risk" as a result of their low birth weight, 5% pounds or 
less, and who will probably have accompanying handicaps as they enter the 
first qrade. This program attempts to demonstrate that such an early inter- " 
vention can orovide such children the experiences necessary to succeed and 
remain in the educational mainstream. - - 

D evelop men t of the Program 

In developinq, the program (formerly the Responsive Environment Program 
for Spanish American Children - REPSAC) has dr^awn heavily upor. various exper- 
imentally devBlooed models i'n early childhood education including: the New 
Nursery School, Northern Colorado University; the respon-sive environment 
c<?ncept of Pmar K. Koore; Project LIFE (Language Instruction to Facilitate 
Education); the Piaget^Early Childhood Curriculum, and various parent involve- 
ment proarans throughout the-natit)n. In addition, the program has adapted the 
Early Prevention of School Failure Model,* a nationally vali.dated Title III 
ESEA developer-demonstrator project. Thus, beginning with the school year 
1975-76, this oroaram is an adaptation of the former Responsive Environment 
Program for Spanish American Children (REPSAC) and the Early Prevention of 
School Failure Project. 

The rationale, for the design and development of REPSAC emanated from 
research which indicated that children with a low birth weight, coupled with 
other factors, generally experience childhood difficulties in the cognitive 



*The Early Prevention of School Failure Project is located at 114 North 
Second Street, Peotone, Illinois and is sponsored by USOE (ESEA, Title III, 
S6c. 306) and the Office of the Superintendent of Public Instruction, 
Springfield, Illinois, ' 



areas of development which can result in subsequent retardation as they 
oroaress through their formaV education. Spanish American cl)ildren with 
such- a . birth weight coupied wit^ a language different from that used in . 
the American educational setting, have additional handicaps. Further, 'Span- 
ish American children with the foregoing handicaps whose home environment 
often does not include toys,, materials, games, and media which can enrich 
their childhood experfences enter the first grade with a notable disadvan- 
tage in comparison to children v/ith such advantages. 

Recognizing that approximately 22°;"of the total sch^V population of 
Clovis wei'e children with a Spanish surname and that approximately 39?b of 
children enrolled" in'soecial education wer^of Spanish orgin, and acceptiJig 
the oreTise that a high percentage (ff "high risk" children come from this . 
particular ethnic grouo, the idea of an early educational intervejdtion be- 
came a. reality 'in the form of REPSAC. REPSAC officially sta-i^d in September 
'1971 wiih 32 students and operated four years (1971-75) ser-ving low birth- 
weight Spanish American children.* During 1971-75, REPSAC was funded by the 
Bureau of Education for the Handicapped. 

' « ' " 

Thus, beainninq vrith school year 1975-76, the ResDonsive Environment 
Early Education Program (REEEP).was expanded to serve low birth weight chil- 
dren of all ethnic groups. 



/ 



*For references pertaining to evaluation results of REPSAC during these 
years, see Bibliography 4, 5, 6, and 7. , 
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' • SECTIOH II- 

■ • * ..^ • 

. - . DESCRIPTION OF THE PROGRAM U 

• The Responsive Environment Early Education Program (REEEP-)-ts designed ^ 
to serve as an educational interv'enticn providing direct services to approx- 
in'.Ttelv forty hioh risk (low birth weight «- less, than S\ lbs..) 3-, 4-, and 
B-ycar-old children, including the integration of ha'ndicappod children, 
livina in the aced served by the Clevis Mumcipal Schools, Clovis, 'tew Mexico 
In add i.t loo, 'the nroarcVt 'serves as a base for trainirtg selected early chilcf^- 
houd .and Mnderqarten teachers and aides employ^ed by various school districts- 
of lie.".' Kex^'co. 

After connlelinq REEEP (1-3 years depending upon the child's age at 
entry), the children will enter the first grade. A foll6w-up study is being 
cotidjctfd 6a these students as they enter the mainstream" of formal ed-ucation 
(Hradei 1-6). ^ ' ' ' . 

' Target Children and Criteria for Selection of Participants 

The target qnoup children of .the program are 3-, 4-, and 5-year-old low 
birth weight" children who are considered edudational ly handicapped. Criteria 
used to select childrenjgii participate in the program are:. -1) low birth 
• weiaht - 5'^. oounds or' lessj 2) Health history of .child; 3) Level of education 
of parents; 4) Educational attainment of siblings: 5) .Home language - Spanish 
or English; and 6) Tncome of family. ^ " ~/ ■ 3 • 

Goals and Objectives ^ ' . • . 

The following goals and objectives give direction to, the organization, 
and administration of the program. . 

y • 

Goals- . 

The major goals of the program are: • • 

1. To prevent school failure 'with an intervention program which 
includes early identification and remediation of developmental 
learning deficiencies and to intergrate handicapped children, 
into the regular school program. 

2. To provide in-service training to selected kindergarten teachers 
and teacher-aides employed by" various school districts throughput 
flew Mexico. - - \ 

3. To. disseminate information concerning the program. 
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ObjectHjes 

Th^e rrajor object vves-- of the program are: 

1. Student Ach'ievWent t^t the- end of the- school year, the student 
wi n be abl e ta; y- . ' ' . ' . ' • ^ * ? 

1 1 De.Tionstrate lanpuaae ability in English which is normally ' 
expected at thevr 'aaQ-.'li>vel ; . EviJence of 'achievement will 
be determined fron- sioni-f icant gain-scores of the Peabody- , 
r Ricture' Vacabulary Tes,t-. .. (Cog-ni-tive) ■ 

1.2 -Derionstrate language abi'Lity in Spanish which is normally 
expected at their age level j/R\*iden£e of achievement will 
. , . * be.detennined- fro'i/significant gafn scores of the Test for 
" ' * • Auditory Con'orchension of Language - .Spapi.sh. - (Cognitive) 

; -* 1 3. Demonstrate school readiness in 'such arecis.to itftclude: listen- 

ind ability: visual acutty; and recognition of sjmi Ian ties, 
- ' ' -.differences, and nutinerical analogies. Evidence of acTiievement 

■ . wij'l -be determined from significant gain socres" of the Read- 

,\ ' iness Te'st for Disadvantaged Children. (Cognitive) 



1.4 



.Exhibit a PQsitivg.self-co^icept cfnd -farvorable emotional devel- 
opr'.enlt?? Evidence"of ^uch b.ehavio'r will, be determined from , - 
rating frpm-the DeveloDmemal • Profiles which -Involve periodic 
• teacher evali'ations i-n six areas'of the -affective >domain: . 
av/areness of i-°lf-, self-confidence, interpersonal Gomprehcnsion, , 
sensitivity to others, effectiveness, and tolerancSV Evidence 
of grOwth/develofJment for. each age-level will be determir^ed from 
individual profile sheets plotted in terms of direction and rate 
of growth developjnent. , (Affective) 



'|2.- In-Service Jraining 



2 1 Upon completion 'of the' various in-service training -sessions, 
teachers and aides will be able to employ various aspects of 
the curriculum in their own educational settings so as to meet 
the needs of children with developmental, lags and learning 
deficiencies. This will include incorpona£ing the approaches 
of p-i^get and Hontessori , using variousMJiaterials such as the 
Project LIFE materials and using the responaive environment . 
typing booth.- Evidence of achievement will be determined by 
observations and written examinations-. 



'I 
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3. ^isser^ination 

3.1 Inforiration concernino the proarafn and operation of the pro- 
qran will bo dissen.inated by various means such as: 

a. Progress reports to the LEA central office, school 
board, and local c*rea nev/s riedia. 

b. Site-visitation by interested individuals and groups, 
both fro.:! in and out-of-state. 

c. CoDi6^ of the end-of-year Evaluation Report will be 
disseminated throughout the state including the Educa- 
tional Resources Inforni-ation Center (CRiC). 

d. Ati:ho end of-^he year, various, types of traininq films 
for use in early childhood education will be developed 
and- will be disseminated throughout the state. 



Activities o^ the prograri can be classified as: instructional; in-service 

dissen in:^tion: and outreach. 

The instructional activities of the program are conducted in two half- 
dav sf^ssir-ris five davs a week. Approximately twenty students attend the morn- 
ing session snd twenty students attend the afternoon session. The students 
are transported to and froni school by a small bus provided by th£ program. 

Specific learnina activities are planned for the children for each three- 
hour day. These learning activities can be generally classified into group 
aativities (story telling, reading, painting, cutting, manipulative toys, 
Dlaynround activities, and the lunch period) and individualized or small group 
activities (Piaqet-Early Childhood Curriculum,, Project LIFE, Responsive, Typing 
Booth, and the Peabody Language Development Kit). 

Eatina the noon meal with attendant language involvement is developed as 
a learning activity: therefore, all of the students are served a hot lunch. 
Themornina grouD is served prior to leaving school, and the afternoon group 
is served icrediately upon arrival for the afternoon session. 

I_n-jervice Acti vi ti es 

The majority of the in-service activities of the progrgm were considered 
as a part of the outreach activities (described later). Other types of in- 
s'^rvirp activities included: attendance at various workshops; enrollment in 
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selected graduate/underoraduate courses at Eastern New Mexico Umversity; 
formal and inforral sessions with vaVious consultants, including rrembers of 
the external evaluation team: and regularly scheduled faculty meetings. 

Pi ssemi na t i on Acti v i ti e s 

Activities vvhich served as means to disseminate information concerning 
the proqran included: preparation of various brochures: newspaper releases: 
pro'^ress rf^ports to the funding agency; central administration office and 
school board; site-visitation by interested groups and individuals; vpious 
speakina engaaefrents by director and faculty: preparation of an audio tapes 
and nnuals- and cooies of the evaluation report v;ere distributed thrdugnout 
the state and nation including the Educational Resources Information Center 
(ERIC - Clearinohouse on Rural Education and Small Schools). Also, a paper 
concerning the progran was presented at a national level professional organ- 
ization. 

Outreach Activities 

Beginning with school year 1975-76, the outreach activities component 
was added to REEE?.* The purpose of adding the outreach activities to the 
parent center wns to give the program the capability of providing replica- 
tion services to various local education agencies. A unique feature of this 
replication service is the capability of taking the training to the replica- 
tion centers by a specially designed and equipped motor coach. 

Three school districts, all in isolated areas and having a large number 
of target children and within a reasonable distance of the parent center 
requested replication of all or part of the parent program during the 1975- 
76 school year. These sc|30ol districts were: Fort Sumner, Artesia, and 
Carlsbad, all located in eastern New Mexico. In addition", replication by 
two other school districts had been made completing their second year of 
operation. This replication was made by the Clovis-Portales Bilingual Early 
Childhood Progran (ESEA, Title VII) with a training site in both Clovis 
and Portales, fiew Mexico (8, 9, and 10). 

The outreach activities component is designed to have three major func- 
tions: advisory and training, diffusion, and evaluation. 



*The outreach activities of REEEP is funded by the Handicapped Children s 
Early Education Program, Bureau of Education for the Handicapped, U.S. Office 
of Education, Qrant No. GOO-75-00079. 



14 



7 



The evaluation tbe outreach acti'/ities also includes a follow-up 
s^-udv of for. er RE^'SAC students as they enter the mainstream of education 
(arades 1-6). The school year 1975-76 is the co-npletion of the third year 
of this follo.v-iin study. 

^2CiLlty/?t3ff/Ad^^^ 

The faculty/st-?ff of REEEP consists of: the director; one certified 
teacher; t;;o teacher-aides: and one custodien/bus driver. 

In a.'dttioit to the rcaular faculty/staff, there is the Professional 
Advis:rv' L.jrd. Th'^' purpose of the Professional Advisory Board is to pro- 
vider thi> director \nt\\ guidance and direction of the activities of the 
pro?'--'' -Ai-i the development of the various prograrr- components. The board 
consists of individuals v;no can provide expertise in the fields of special 
education, early childhood education, bilingual and bicult.ural education, 
educational technoloqy and the responsive environment concept. 

n^rcs Of personnel associated with the REEEP are listed on* the back 
of ths co\'fir paoe of this report. 

Location and Physical Facilities 

The proiect is located about six blocks southwest of the Central busi- 
ness area of Clovis, and the physical facilities blend into the surrounding 
buildinas and are not discernable from the rest of the community except by 
a si^n on one of the houses. The physical -facilities of the program consists 
of tv.'o'houses with an adjourning yard. One house, which is a renovated 
..forrer single fanily dwelling, is used as the main teaching facility, and the 
other building serves as office and workroom which is a renovated former 
beauty shop. , 0 
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SECTJOri III 
EVALUATION 

The external evaluation of REEEP was conducted by B. E. Askins and ^ 
Associates v.hlch is an Independent consultant and service organization with 
its direction nrinarily throuqh various feculty a;e;^ibers of the College of 
Education, Te>.:sS Tech University, 



l^K: puipo>- of this external evaluation study was to collect and provide 
in^nr ;tiDn r.ercssarv for decision-r^'.kinc; relative to student and program 
D'-o.!'Cc^.. S-jch -'r.for ation was furnished to the proqrem director, the LEA, 
arid to t'ii' fur.-iirc! a^-cncy. 

'I.iior eU":nts of this external evaluation consisted of: 

1, Providina a variety of professional personnel appropriate to the^ 
evaluation the program including: personnel to -administer tests, 
site-visits, analysis, and report writing. 

2, Obtaininq and administering the selected standardized tests in 
. accordance with the evaluation design, 

3, Providina the oroject direci,or with baseline data which could be 
used in the proqrari planning and operation, -These data were mainly 
the results fron5 the protesting phase, 

4, Preparing two interim and the end-of-year report, 

5, Disseminating evaluation reports and- other information. pertaining 
to the evaluation of the program. 



Eval uation Design 

The desian for the external evaluation for 1975-76 was based primarily 
uDon the orogram objectives as pertains to student achievement (1-1 through 
1-4), The objectives v/ere objectively r'easured with standardized tests 
using a Dre-oosttest design, A sufnnary description of the objectives and 
instruH'ents used are as follows: 

Obj;ectiye Instrument 

1 1 Lanauaqe developi^snt in English Peabody Picture Vocabulary Test 

(PPVT) 

1.2 Lamuage develop-ent in Spanish Test for Auditory Comprehension of 

Language (TACL) 
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1 Sc^-ocl ^.«=d1ness Readiness Test for Disadvantaged 

Children (RTDC) 

i.-i Self concept and personality Develop;nental Profiles (DP) 

develor'^efit 

Fern A -f'-.d Forn B of the PPVT and P.TDC were used as the pretest and 
poctti'St »•€;: - itivolv. The sa-^e for^- of the TACL was used as the pre and 
po^ttt'?.t. Tr- use of the Dovelop~ental Profiles is described later. 

A brief fion-tcchnical dascription of the test instruments is included 
in f.rcc-r.dix ."•>. 

Pro.'^-JL.'-e 5rc'__Ti^ e-Schedjlc for Coll ec tine; Data 

io c'tlu.te objectives 1.1 - 1.3 were collected with the use of 
st.->r;j'.,-'i-f d -.n'thin Vr/j f re- ework of a quasi -experinental design com- 

- .'.Iy r-t %' 't;: to as a "Ti o Desian" or ' Pretest-Posttest Design Only" (16). 
This c'':'Sif n involved a simU experiFsntal qrouD without a control qrouD. 
The suiir-:t Ofc;.': (ito procu-a-, particiDants) was rieasured on-a dependent 
v:'ri.-;t.:e iihe oretcst), and was then qiven the experimental treatment (in- , 
structionil activities). Followinq the treetuent, the subject group was 
roasii'-'-d L^.-Jr, on the sar^o variable (posttest), and a statistical comparison 
was r^.ie t-et-vjcn the neans of the two measurerrients . 

Dati to evaluate objective 1.4 was collected with the use of the Devclop- 
ne-.t:! Profiles. This instrunent was completed for each student three times 
dt.ring the year by the classrooms teacher and aides. 

The dates for administering the pretests were September 2-5, 1975, and 
the oosttests were administered" May 10-14, 1976. The Developmental Profiles 
were cor ol'etcd durinq Septef..ber, February, and May. 

In addi'.ion to the above stated wasures {pre and posttests), there were 
various on-ooinq subieotive-evaluation procedures. This consisted mainly of 
site-visits by the evaluator so as to observe and become familiar with the 
daily operation of the progam. Assistance with the subjective evaluation of 
the other objectives was accon-plished during these site-visits. 

S't at i s t i ca 1 Tr ea tmen t_j) f_Da ta^ 

As concerns the collected data froni the standardized tests, a mean gain 
scnre was conputed for each test (posttest score minus pretest score) by age 
and year in program. Also, comparative data were reported concerning the 
second-year and third-year students. The t-test was used to te^t for sigm- » 
ficance of difference between the mean gain scores. 
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As concerns the Develocrrental Profiles, the mean was computed for each 
child for each r.^rkinc period and was "plotted" on a standardized scale to 
indicate direction and rate of growth/change. 

Sur-rary C hart of the Evaluation Plan 

A sur-^ary of the varioDs evaluation activities is presented on the next 
page in the 'Ivaluction Plan Su">:>iary Chart". 



Addi tion a l Eval uation Data 

^ A scnarato e-.xternal evaluation study of the outreach activities, in- 
cludi;- ' the follc./-up study of fornor REPSAC students, was conducted. Infor- 
r :>tion <: t.';c'?rr<ir.'i this report can be obtained either from the project director 
cr t'nc e; ternal cvaluator. 
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, SECTIOfi IV 
■ EVALUATION RESULTS 

The design for the external evaluation for 1975-76 primarily focused 
upon the program objectives as pertains to student achievement (1.1-1.4). 
A list of the soecific objectives can be found in Section II, and a detailed 
description of the evaluation design can be found in Section III. 

Number of P articipants 

^j, • — 

At the beginning of the school year, there were 42 students enrolled in 
REEEP (24 boys and 18 girls); 6 third-year students; 14 second-year students; 
and 22 initially started the program this yean, ( 

The pretesting phase included 42 students and the p.osttesting phase in- 
cluded 41 students. The number of students who we^e^both pre and posttested 
was 30. The reason for N=30 was because, of student withdrawals and new 
entries info the program. 

Student Achievement 

The objectives (1.1-1.3) were objectively measured with standardized 
tests using a pre and posttest design. A summary description of the objec- 
tives and instruments used are as follows: ^ 

Objective Instrument 

1.1 Language development in English Peabody^Picture Vocabul^ary Test 

1.2 Language development in Spanish Test for Auditory Comprehension 

of Language (TACL) . 

1.3 School Readiness " Readiness Test for Disadvantaged - 

Children (RTDC) 

1.4 Self concept and personality Developmental Profiles (DP) 

development 

The students were measured at the beginning of the school year on three 
factors (1.1-1.3). At the end of the year, the students were again measured- 
in the same areas. Progress in each area v/as determined by the amount of 
gain accomplished between the pretest and posttest. In addition, gain scores 
were used to compare performance between first, second, and th,ird.-y ear stu- 
dents. Also, gain scores were used to compare performance o.f the' 3-, 4-, and 
5-year-olds participating in the program. All of these di-fferences were 



20 



13 



statistically treated using- the t-test with significance being determined 
at the .05 level. 

The last obiective (1.4) pertained to the assessment of self concept 
and personality development. The Developmental Profiles were completed by 
the teacher and teacher-aides three times during the year, September, Feb- 
ruary, and M.ay. Change/growth for each student was determined by averaging 
the two ratings for each' period and plotting the results on a profile sheet. 
Group change was determined taking an average of the individual ratings for 
each of the seven areas measured. 

Language Development in English 

Objective 1.1 pertained to language development' in English. A signifi- 
cant mean gain score" (H6=43. 40, p <.001) was found in this area; therefore, 
it was concluded that this objective was achieved. Statistical data concern- 
ing language development in English are presented in Table 1. 

Language Development in Spanish 

Objective 1 2 pertained to language development in Spanish. A signifi- 
cant mean gain score (MG=25, p <.001) score was found in this area; therefore, 
it was concluded that this objective was achieved. Statistical data concern- 
ing language development in Spanish are presented in Table 1. , 

School Readiness 

Objective 1.3 pertained to school readiness. A significant mean gain 
score (HG=10.57, p<.001) was found in this area; therefore, it was concluded 
that this 'Objective was achieved. Statistical data concerning school readi- 
ness are presented in Table 1. 







TABLE f 








1, 


PRE AND 


POSTTEST PERFORMANCE OF REEEP STUDENTS 






TEST/OBJECTIVE 


N ' 


MEANS 


MEAN 
GAIN 


s 




t 


PPVT- English 
(1.1) 


30 


PRE, 22.40 
POST 65.80 


43.40 


15.40 
12.63 


. 6 


.82* 


TACL - Spanish 
(1.2) ^ ■ 


30 


PRE 18.36 
POST 43.36- 


25.00 


15.03 


J 


.269* 


RTDC ^ Readiness 
(1.3) 


30 


PRE 18.18 
POST 28.75 


10.57 


22.16 
8.21 


3 


.842* 


*(p<.001)- 
**(p<-. 01) 
***(p<. 05)' 
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Analysis By Age and Year in Program . 

By Age . An additional analysis was conducted concerning the overall 
performance of..the students by age in the three forementioned areas. It ^ 
was hypothesized that students participating in REEEP at age 3, 4, and 5 
would show a significant gain in the areas measured. The data indicated 
that this hypothesis can be supported for all ages and for all areas mea- 
sured except lanauage development in Spanish for age five. This lack of 
significant gain'in Spanish for five-year-olds is' consistent with-earlier 
findings and may reflect a greater reliance on the English language to func- , 
tion in school. These data are presented in Table 2. 



TABLE 2 



AGE AND TEST PERFORMANCE OF ^^EEEP STUDENTS 


TEST/OBJECTIVE 


AGE 


N 


MEAN 
GAIN 


t ' 


PPVT- Eng.lish 
(1.1) 


3 

,4 
5 


7 
9 


45.25 
51.81 

33,. 15 


5.93* 
6.84* 
4.26* 


TACL- Soanish 
(l".2) 


3 
4 
5 


7 : 

14 
9 


27.25 
33.12 
14.21 


T.43** 
4.16** 

.1.63 N.S. . 


RTDC- Reading 
(1.3) . 

✓ 


3 ■ 

4 

5 


7 

14 

9 


12.33 
9.16 
8.48 


3.04** ' ^ 
2.81** 

2.63*** ' " ' 



*(p<.ooi)" ' . ; ■ 

**(P< . 01) ' ■' ■ ' c 

***(p< .05) 

B y Year in Program . An additional analysis' was cofiducted concerning 

the overall performance of the students according to year-in-program in the 
three areas measured, - " 

First, second, and third-year students made significant gains in lan- 
guage development in English,' language development in Spanish, and school 
readiness. These data are presented in Table 3. 
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TABLE 3 

YEAR IN PROGRAM AND TEST PERFORMANCE OF REEEP STUDENTS 









MLAN 




TEST/OBJECTIVE 


YP 


N 


GAIN 


t 


PPVT - English 


1 


13 


51.40- 


9.12* 


(1.1) 


2 


. 12 


43.16 


6.40* 


3 


5 


39.41 


6.11* 


TACL - Spanish 


1 


13 


37.13 


5.26* 


(1.2) 


2 


12 


30.12 


4.83* 


' 3 


5 


25.41 


~4.01* 


RTDC - Readiness 


"1 • 


13 


23.45 


3.32** 


•(1.3) 


2 


. 12 


17.1.7 


2.99*** 


3 


5 


10.11 


2.86*** 



*(p<.001) 
**(p<. 01) 
***(p< . 05) 



Self Concept and Emotional Development 

Objective 1.4 oertained. to developing a positive seff concept and favor- 
able emotional development. This measurement was obtained from three subjec- 
ti.ve evaluations made by the teacher-aide using the Developmental Profiles. 
Results of these average ratings for first, second, and third year students 
are presented in Figures 1, 2, and 3,. As reflected in these figures, posi- 
tive and continuous growth was made by the students; therefore, it was con- 
cluded that objective 1.4 was achieved. ' 
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FIGURE 5' - PERSONAL DEVELOPMENT PROFILE FOR SECOND YEAR REEEP STUDENTS 
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FIGURE 3 - PERSONAL DEVELOPMENT PROFILE FOR THIRD YEAR REEEP STUDENTS 
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In-Service Training 

Objective 2.1 pertained to the in-service training of the teacher and 
aide. Assessment of the in-service training activities involved site-visits, 
written exam, and discussions with the project director and faculty. 

The majority of the in-service activ-ities were conducted by the outreach 
activities comoon^t (outreach activities are described in a separate report). 
Other types of' in-service activities included: attendance at various workshops; 
enrollment of designated graduate/undergraduate courses at Eastern New Mexico 
University; formal and informal sessions with various consultants, including^ 
members of the external evaluation team; and regularly scheduled faculty meet- 
■ ings. 

An outstanding feature of the in-service training for the 1975-76 school 
year was the attendance of tv/o v;orkshops before the school year started. 

The first workshop. Workshop on Implementation Procedures on Early Pre- 
vention of School Failure, -was conducted at Eastern New Mexico State Univer- 
sity, May 28-30, 1975. . This workshop v/as conducted by a dissemination t^am 
from the Early Prevention of School Failure Program, a nationally validated 
ESEA Title III project, located in Peotone, Illinois. This workshop focusing 
on kindergarten. age children, was ^lesigned to provide school personnel know- 
ledge and skills necessary to implement screening programs in their respective 
schools. In addition, the workshop attempted to, assist the participants in _ 
the planning of educational experiences for kindergarten children with certain 
developmental laas. Specifically, the workshop participants were expected to: 
1) Acquire the skills necessary to implement a screening model for kindergarten 
age chijdren; and. 2) Develop strategies designed to meet the unique educational 
nee;ls of each child.- 

The second workshop. Early Childhood Bilingual/Bicultural Education: Why 

and How, was conducted at Eastern New Mexico State University, August 18-20, 

4975' This workshop 'was conducted, by three faculty members of the Metropol- 
itan' State College, Denver, Colorado. This workshop, focusing on kindergarten 

arge c"fH-Tdren, was designed ta provide teacher and teacher-aides knowledge and 

skills necessary to implement/ improve programs in early childhood bilingual/ 
bicu]tur:?l education. 

Another Strong feature of the in-serv,ice training' program was the teacher 
and aid6 working very closely witli the outreach fr^iri.ing team which included: 
early childhood specialist; educational diagnostician and language specialist: 
and a speech therapist. , ^ 

Another outstanding, feature of the in-service training program was the 
attendance of the teacher anJ aide of designated courses at Eastern New Mex- 
ico Universi-ty. One such course was Working with Spanish Speaking Children. 
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Considering the quantity and quality of the in-service training activi- 
ties, it was conducted that the objective pertaining to in-service was 
achieved. 

Dissemination 

Objective 3.1 pertained to quantity and quality of dissemination of 
information concerning the program. Information concerning the project was 
disseminated as described in the follov/ing paragraphs. 

Progress reports v/ere made available to. the central administration 
o'ffice, school board, local area news media including nearby Cannon Air 
Force Base,..che State Department of Education, the U.S. Office of Education, 
and the U.S. Senators from New Mexico. ^ ' 

Much publicity was received when the project was notified of an invita- 
tion from the National Diffusion Network for the program to serve as a 
national demonstration site for the Early Prevention of School Failure 
Project of Peotone, Illinois. 

Over 6,000 copies of the brochure, "Parents: Do You Know the Early 
Warning Signs of Children with Specid Needs," were distributed in grades • 
K-6 of the Clovis Municipal Schools. 

The development of six one-minute video cassette spots for use on tele- 
vision. These were developed in cooperation with KENW-TV, ENMU, and this 
material was presented to the Governor's. Commission for Public Broadcasting 
ip March, 1976. 

Presentations of the project were made at: -the annual meeting of the 
New Mexico Speech and Hearing Association at Eastern New Mexico University, 
April, 1976; various classes in Child Development at ENMU; and to the Ehi4U 
Chapter of the Council for Exceptional Children. 

The project was co-sponsored of* the Early Childhood Education Conference 
in Albuquerque, April 29-May 1, 1976. This conference was attended by over 
200 administrators, teachers, and teacher-aides from throughout New Mexico. 
Presentors included nationally known speakers. Also, various training ses- 
sions were conducted during the conference by personne-1 o.f the Clovis project 
'In addition, there were representatives in attendance from eight natiorially 
validated Title III early education programs. As part of the conference, 
the participants drafted a resolution pertaining to state government support 
of development of early childhood education which was- later presented to the 
Governor at the People's Forum, on Education in Albuquerque on May 21-22, 1976 

The project used student teachers from nearby Eastern Nev/ Mexico Univer- 
sity and thereby disseminated information through the university. , 
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Site-visitations by many professional individuals and groups as v/ell 
as parents. 

A pap'er was presented by the evaluator concerning the project at the 
annual meeting of the American Educational Research Association, San Fran- 
cisco, California, April, 1976 

Copies of the end-of-year evaluation reports were disseminated through- 
out the states of flew Mexico and Texas. Also, these reports were accepted 
into the network of the Educational Resources Information Center (ERIC) in 
the Clearinghouse of Rural Education and Small Schools, Las'Cruces, New 
Mexico 

In addition to the above, much information concerning the project was 
disseminated by the outreach activities component which was added to the 
program this year. Descriptign and evaluation of the outreach activities 
were reported for 1975-76 in a separate report. 

Based on observations and interviews with various scjiool personnel, it 
was concluded that the quality and quantity of disseminated materials were 
more' than adequate. Therefore, it was concluded that the objective pertain- 
ing to the dissemination of information v/as achieved. 



Outreach Activities 

Evaluation of the outreach activities (See Section II) was not a part 
of this evaluation study, however, an external evaluation study of the out- 
reach activities was conducted. The results of this evaluation were reported 
in a separate report.* Information concerning thereport can be obtained 
from the project director. 



Follow-Up Study of Forner REPSAC Students 

A baSic concern of those' who have been associated with this project 
(REEEP formerly REPSAC) during the past several years is the status of • 
former students now enrol'led in public and private schools. This concern 
has generated a continuation of a follow-up study of former REPSAC students. 
"The study was conducted in 1974 and 1975 and was again conducted at the end 
of the 1975-76 school year. Results of the follow-up study during 1975-76 
were included in the evaluation study of the outreach activities.* Informa- 
tion concerning this report can be obtained from the project director. 



*This evaluation study was funded by the Handicapped Children's Early 
Education Program, Bureau of Education for the Handicapped, U.S. Office of 
Education (Grant No. GOO-75-00079) . 
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SECTION V 
SUtWARY, FINDINGS, AND CONCLUSIONS 



[ 



Summary 

•The Responsive 'Environment Early Education Program (REEEP) was 
designed to serve as an educational intervention providing direct services 
to approximately forty high rislCflow birth weight - less than 5!i pounds) 

3- T, -and 5-year-old children, including the integration of handicapped 
children, living in the area .served by the Clovis Municipal Schools, C ovis. 
New Mexico. In addition, the program served as a base for training selected 
early childhood and kindergarten teachers and aides employed by various 
school districts .of New Mexico. 

After completion REEEP (1-3 years depending upon the child's age at. - 
entry), the children enter the first grade. A follow.up study being 
conducted on these students as they enter the mainstream of fo^-^^l education 
(Grade's 1-6). This follow-up was conducted as a separate study and report. ■ 

•ahe evaluation design for 1975-76 was based primarily upon the program- 
objectives as pertains to student achievement. Also, the objectives per-, 
taining to, in-service training and dissemination wer-e assessed, ... 

•' Findings 
The major find.ings of this 1975-76 evaluation study were: - 

- ■ 1. REEEP students made significant gains in:" language ability in 
English; language development in Spanish; and school readiness. 

2 • When the test data were -analyzed by age of the students, the 3-, 

4- . and 5-year-old groups made significant gains in each of the three areas 
measured except the gain was not significant in language development in . • 
Spanish for the 5-year-old group. ■ . 

3 When the test data were analyzed by year in program (first, second, 
or third), each group made significant gains in the three areas measured. 

' 4. The REEEP students showed a positive and continuous growth as 
concerns self concept and personality development. 

5 The RE^EP students were found to be extremely friendly and cooperative, 
willing to try various tasks without fear of failure, and an unusually long 
attention span for this age and type of children. 
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Conclusions ■ 



Based upon the findings of. this study, the major conclusions were:. 

1. All of the program objectives' pertaining to student achievement, 
in-service training,. and dissemination were achieved. 

- 2, The program is in an active and positive process of accomplishing 
the long range program goals. 

* * • 

3 The program has the organization, curriculum, materials, facilities, 
and a qualified and dedicated facility/ staff to provide the needed educational 
experiences for the target children; therefore, it was concluded that REEEP 
'is serving as an effective educational intervention for the specified target 
children. 

Recommendation 

Based upon the firings and conclusions of this study, the following 
suggestions or reconmendations were mSde: 

1. That' REEEP continue to develop and serve as an early childhood and 
bilingual -education intervention program and as a^ demonstration and repli- 
cation model. 

2. That the evaluation design for the program during 1976-77 be 
expanded. ♦ 

3. That the follow-up sti/dy of the former REPSAC/REEEP students be 
made a part of the external program evaluation of REEEP. 
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. APPENDIX A 
DESCRIPTION OF INSTRUMENTS 



. A J)rief non-technical description of each of the test instruments 
is listed in the following paragraphs. Personnel interested in more detail 
concerning the tests' are invited to consult technical data provided by the 
^publishers of the tests or- refer to the Mental Measurements Yearbook , 
BuItos, editor. 



Language Development 

*^ 

English 

* « 

The Peabody Picture Vocabulary Test (Dunn) is designed to provide 
an estimate of a subject's "verbal intelligence" through measuring his 
hearing vocabulary The test also has wide utility as a clinical tool. 
Besides being effective with average subjects, it has special value with 
certain other groups. Since subjects are not required to read and the 
responses can be non-oral, the test is especially fair to non-readers and " 
remedial reading cases. With the drawings free of fine. detail and figure- 
ground problems, the test is apparently appropriate for at least some 
perceptually impaired persons.' According to the^ Test Manual , the scale is 
appropriate for subjects 2^-18 years who are able to hear words, see the 
drawings, and have^the facility to indicate "yes" and "no" in a manner 
which communicates. 

This standardized test is published by American Guidance Services, 
Inc», Circle Pines, Minnesota. 

Spanish 

The Test for Auditory Comprehension of Language (Carrow) measures the 
child's understanding of the Spanish language structure. The test is com- 
posed of 101 plates of pictorial referents. The child responds to eeich of 
the examiner's oral stimuli by pointing to one of three line drawings. Re- 
sponses are recorded on a separate scoring/analysis form. The test is 
.designed for individual administration, by speech and testing specialists. 
Test results can also be used to diagnose the language competence of bilin- 
gual and mentally retarded children as well as those with hearing, articula- 
tion, or language disorders. 

This standardized test is published by Learning Concepts, Inc., 
.Austirt, Texas. 

School Readiness 

The Readiness Test for Disadvantaged Pre-School Children (Walker) 
was adapted from the final report of a project conducted by Dr. Wanda 
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Walker, Northwest Missouri State College, and supported by the Office of 
Education. The tesi consists of multiple-choice items based on pictures 
and symbols which do not require reading ability and are designed to test 
a child's listening ability; visual ability; and his recognition of simi- 
larities, differences, numerical analogies, and missing parts. 

This standardized test is available from ERIC Reproduction Service ^ 
(ED 047 1 68)., Bethesda, Maryland. « 



Self Concept and Personality Development ''. 

The Developmental Profiles (Bessel.rand Palomares) is a subjective 
evaluation of, children's behavior under a variety of circumstances. 
These rating scales are prepared periodically jointly by two teachers. 
The teachers make ratings on a printed form according to six affective 
areas: awareness of self ;"self-conf idence; i-nterpersonal -comprehension; 
sensitivity to others; effectiveness; and tolerance. Becaus:e of the in- 
herently subjective nature of these profiles, there is no objective scale 
of accomplishment or standard in terms of age-achievement scores. The 
profiles can provide a source of insi.ght and understanding of emotional 
and personality development. 

This instrument is published by the Human Development Training Insti- 
tute, El Cajon, California. 

Workshop Evaluation 

The Workshop Evaluation System (McCallon) provides a scientific ap- 
proach to gathering and using participant feedback in the evaluation of/ 
conferences, workshops, conventions, and in-service training programs. 

Participant responses are gathered on seven dimensions - organization, 
objective, work of the presenter, ideas and activities, scope, benefit, 
and overall effectiveness. The Workshop Evaluation System is .unique in that 
it provides normative data collected from over 40,000 workshop participants. 
Participant feedback scores are compared against the norms to ensure reli- 
able analysis and interpretation of workshop effectiveness. 

This ..instrument is published by Learning Concepts, Inc., Austin, Texas. 
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